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Abstract 


Science learning in the 21st century should develop the abilities of the students to find 
solutions to the problems. This task requires a set of skills called Higher Order Thinking 
Skills (HOTS) and innovative assessment should be designed to gauge the acquisition of 
these skills. Thus, this study aimed to create an innovative HOTS-based assessment tool in 
science learning. It entailed a method following the research and development model. It 
covered the topic of genetics and involved biology experts and junior high school students. 
The result initially showed that the assessment tool has high content validity. It further 
revealed that the items have a high-reliability index and they loaded on components based 
on the three HOTS intended for the test. Thus, this paper concludes that the HOTS-based 
assessment tool is a good classroom test to gauge the science learning of the students. 
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INTRODUCTION 

Education has a primary role to 
equip students with skills to be able to 
face future challenges, including the 
challenges of 21st-century learning. The 
21st-century education entails various 
skills to help students maturely achieve 
global life. These skills include the 
HOTS as well as critical thinking, 


problem-solving, metacognition, 
communication, collaboration, 
information literacy, and _ creative 


innovation (Copley, 2013; Kane, Lear & 
Dube, 2014; Saido et al., 2015; Akiba 
and Wilkinson, 2016; Baloche and 
Brody, 2017; Arthur et al., 2019). 

The term for the 21st-century 
skills 


for a broad set of 


skills, 


stands 


knowledge, behavior, and 
character traits that are crucial for 
students to survive the fast-changing 
world and lead an ideal life by shaping 
academic life and future career 
(Rahman, 2019). The target of achieving 
21st-century skills can be done by 
renewing teaching quality. Student- 
centered teaching skills must be 
implemented in teaching in 21st-century 


learning. This is intended for project- 


based learning and _ problems to 
encourage collaboration and 
communication that will increase 


student involvement and motivation 
(Lemus et al., 2014; Jewpanich and 
Piriyasurawong, 2015; Sener, Tiirk and 
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Tas, 2015; Khan et al., 2017; Khoiriyah 
and Husamah, 2018). However, there is 
a perennial challenge in developing the 
HOTS of the students in science learning 
(Nisa, Nadiroh & Siswono, 2018; 
Djamahar ef al., 2019; Sigit et al., 2020). 
One of the reasons is that teachers 
mainly focus on teaching lower-order 
learning rather than higher-order 
thinking skills in their science teaching- 
learning (Rahman, 2018; Sultana & 
Rahman, 2018). Natural science 
learning covers various aspects ranging 
from biology, chemistry, physics, and 
the environment. Science learning 
presents many problems that need to be 
solved. This is aside from the fact that 
science serves as a primary launching 
pad for emerging competencies and 
contents that have social significance 
(Cahapay, 2020a; Cahapay, 2020b). The 
relevant topics such as damage to the 
urban environmental ecosystem, climate 
change, poor urban planning 
infrastructure, consumption of nutritious 
food, and the genetic influence of living 
things in biotechnology are some of the 
issues that need to be studied and 
2013; 


2019; 


resolved (Nugraini ef al., 


Kristyowati & Purwanto, 
Paristiowati et al., 2019; Rahmayanti, 
Maulida & 2019; 
Rahmayanti, Oktaviani & Syani, 2020; 


Azwar et al, 2013; Intarti et al, 2014). 
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Learning biology emphasizes a 
kind of learning that prioritizes aspects 
of systematic and logical thinking. In 
21st-century biology learning, the 
development of thinking should not only 
focus on the aspects of understanding 
various concepts but also on the aspects 
of critical thinking and analysis. Ideally, 


these aspects can be developed in all 


contents and materials of biology 
learning (Song, 2016; Tiruneh et al., 
2017). 

To achieve the 21st-century 


biology learning objectives, with a focus 
on genetic content and material in this 
paper, it is necessary to develop an 
assessment form based on HOTS. In 
addition to the aspects of systematic and 
logical thinking, aspects of critical and 
analytical thinking should also be 
reflected in the form of the HOTS 
assessment to be developed. Thus, this 
study aimed to develop a HOTS-based 
assessment tool for genetic topics for 
junior high school students. 
METHOD 

The research method used in this 
study followed the research and 
development model proposed by Gall, 
Gall, and Borg (2003) with modification. 
The study was conducted from 2018 to 
2020. It followed the test development 
procedure consisting of 4 steps: (1) 


(2) 


assessments; (3) developing assessment; 


analyzing —_ needs; designing 
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and (4) conducting assessment 
validation. 
First, content validation was 


conducted. The experts involved in this 
stage were three biology graduate 
students and two biology education 
school teachers. The content validity 
criteria were adapted based on 
Ratumanan & Laurens, (2006) which can 
be seen in Table 1. 


Table 1. Validation criteria 


Interval Category Criteria 
3.25<x <4,00 Very Valid 
2.50 <x < 3,25 Valid 

1.75 <x < 2,50 Less Valid 
1.00 < x < 1,75 Not Valid 


After content validation with the 
experts, the test items were further 
subjected to a reliability test. The test 
items were administered to 28 students in 
the Grade IX junior high school level. 
Reliability is the extent to which the same 
test scores would be obtained if the test 
were administered again. Test scores that 
yield reliability of 0.80 or higher are 
generally considered reliable (Gall et al., 
1996). 

Finally, the test items were 
subjected to factor analysis to determine 
their construct validity. A factor analysis 
utilizes student responses to determine 
groups of questions that are answered in 
a correlated manner by the respondents, 
indicating thinking skills that are related 
(Adams and Wieman 2010). A type of 
factor analysis used in this study is the 


principal component analysis to provide 
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an approximation to the required 
components. The items that load on one 
component above .30 are considered 
efficient factor loadings in this study. 
All the tests were performed using 
the Statistical Package for the Social 
Sciences (SPSS). 
RESULTS AND DISCUSSION 


This paper is aimed to develop a 


high school students. This instrument is 
designed to measure HOTS in the form of 
essay questions. As seen in Table 2 and 
Table 3, the results of the developed 
assessment consisted of 12 items under 
two different subtopics. Each subtopic 
had 6 indicators that contained 1 test 
item. The subtopics were DNA as the 


first subtopic and biotechnology as the 


HOTS-based assessment tool for junior second. 


Table 2. HOTS assessment grid 
Sub Chapter 1. Structure of DNA and RNA Functions 


Aspect Item No item 
C4 (Analyzing) Students can analyze DNA functions as the inheritance 1 
Students can analyze the function of DNA and RNA 2 
based on their structure 
C5 (Evaluating) Students can provide an assessment of DNA locations in 3 
the cell nucleus 
Students can criticize a statement about DNA and RNA 4 
C6 (Creating) Students can make suppositions (hypotheses) against an 5 
inheritance-related event 
Students can design a simple research project about 6 
inheritance 
Sub Chapter 2. Application of the Concept of Genetics 
Aspect Item No item 
C4 (Analyzing) Students can analyze genetic abnormalities 1 
Students can analyze the function of DNA in inheriting 
a characteristic disorder 2 
C5 (Evaluating) Students can provide an assessment of a genetically 3 
modified product 
Students can provide criticism of genetically modified 4 
products 
C6 (Creating) Students can make hypotheses about the effects of 
nuclear use on DNA and cells 5 
Students can design a simple research project on waste 6 


management through genetic engineering technology 


Table 3. HOTS Assessment developed 
Sub Chapter 1. Structure of DNA and RNA Functions 
Item 

1 DNA is a very important thing for life. There are nowadays widespread cases 
involving DNA testing to determine a person's status in a family. Why do you 
think DNA can determine one's kinship? Explain and do analysis! 

2 DNA and RNA are similar in structure. The difference is in the number of strands. 
Why is only one strand of RNA? What happens if DNA has only one strand? Do 
analysis! 
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No 


Sub Chapter 1. Structure of DNA and RNA Functions 
Item 


DNA in animal and plant cells is located in the cell nucleus, whereas DNA in 
bacteria is located in the cytoplasm. Give an opinion and evaluation of excellence 
obtained by the position of DNA inside the cell nucleus? 

"DNA is an important substance in life. All living things and their environment 
have DNA. So that living things and the environment can also inherit their nature 
" Give critic and correction to the statement above! 

A tree has a red flower. It is then crossed with the same tree species and produces 
a tree with green flowers. How can this phenomenon occur? Make a hypothesis 
about this. 

Make a research plan about genetics with the following tools and materials: 

- 3 red rose trees 

- 2 pink rose trees 

- 2 Pots 

- a knife 

- A guidebook for crossing plants 

- water 

- manure 

- compost 


Sub Chapter 2. Application of the Genetics Concept 
Item 


Hemophilia and color blindness are abnormalities caused by genetic factors. If a 
person's parents experience a genetic disorder, is it going to be passed down? 
Explain based on your analysis! 

Someone who has Turner syndrome loses one chromosome in his body. In your 
opinion, will the chromosome lose one chromosome at the time of cell division, 
or does it have a complete chromosome? 

Explain and do the analysis 

Seedless watermelon is a product of genetic modification. The watermelon is more 
in demand in the market than seeded watermelons. Give your opinion and 
evaluation of the consumption of seedless watermelons for health! 

The use of genetic modification to make fruit without seeds is beneficial but also 
had a negative impact. This is not too much concern for the industry by planting 
fruit from genetic modification. What should be done by various parties to 
overcome this? Try giving a critic of this event! 

Someone was found to have a DNA mutation because he worked for 5 years in the 
hospital especially in x-ray rooms that use X-rays. While his other colleagues who 
were in the administration room did not experience mutations. Make a hypothesis 
as to why this happened? 

Bacteria A can digest odor-causing chemicals. Meanwhile, it can only live on the 
ground. While bacteria B can live in water. Make a design research project that 
you can do to eliminate the waste and odor that exists in the river using the 
principle of modern genetics! 


Table 4. Validation results of experts’ assessment 


No Expert Score Category 
1 User 1 3.08 Valid 
2 User 2 3.58 Very Valid 
3 User 3 3.66 Very Valid 
4 User 4 3.66 Very Valid 
5 User 5 3.66 Very Valid 
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Table 5. Reliability index of the test items 


No Item Sub Chapter 

Item 1 Sub Chapter 1 
Item 2 Sub Chapter 1 
Item 3 Sub Chapter 1 
Item 4 Sub Chapter 1 
Item 5 Sub Chapter 1 
Item 6 Sub Chapter 1 
Item 7 Sub Chapter 2 
Item 8 Sub Chapter 2 
Item 9 Sub Chapter 2 
Item 10 Sub Chapter 2 
Item 11 Sub Chapter 2 
Item 12 Sub Chapter 2 


Overall Chronbach Alpha 


Table 6. Factor analysis of the test items 


Chronbach Alpha if Item Deleted 
843 
848 
849 
836 
854 
839 
836 
835 
843 
841 
839 
854 
Ba9 


Item Component 1 Item Component 2 Item Component 3 
1 .692 3 154 5 847 
2 .223 4 387 6 .619 
” .903 9 .708 11 .466 
8 587 10 645 2 .003 


The items of the HOTS-based 
assessment tool were initially content 
validated by the experts. As seen in Table 
4, the experts rated the tool as valid and 
very valid. It suggests that it has technical 
adequacy for instructional use. The 
experts provided the best assessment for 
the aspect of the communicative 
language used and followed by the ability 
of the developed assessment to foster the 
power of student analysis. The comments 
generated from the validators focused on 
the making of more varied assessments 
by adding images. 

Then, the items were subjected to a 
reliability test to determine _ their 
dependability. As shown in Table 5, the 
overall result showed a Chronbach alpha 
of .855 indicating high reliability. It 


the 
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dependable classroom test. It can be also 
noted that the overall reliability index of 
the test did not improve if an item is 
deleted. Overall, the instrument is a 
reliable test to measure the HOTS of the 
students in natural science. 

The test further underwent a factor 
analysis to confirm its construct validity. 
The preliminary statistics of factor 
analysis showed the Kaiser Meyer Olkin 
value at .662 and Bartlett Test of 
Sphericity was significant at .000 level, 
indicating that the sampling is adequate. 
The result also showed a total of 12 
components with initial eigenvalues of 
0.1 and higher of which three factors 
satisfied accounting for 39.79%, 15.76%, 
and 10.28% of the variability. As shown 


in Table 6, the rotated component matrix 


revealed the factor loadings for each 
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item. The items were subjected to 


principal component analysis to 
approximate the required components 
corresponding to the three HOTS in 
which the test items were intentionally 
designed. It was noted that all 12 items 
cross-loaded in more than one 
component, but most had a minimum 
factor loading of 0.30, thus considered 
acceptable. The analysis of the test items 
revealed the characteristics of the items 
each of the three 


common for 


components. The items that loaded under 


Component 1 are those items that 
required the students to analyze; 
Component 2 to evaluate, and 


Component 3 to create. 


Each item of the developed 
assessment represented open-ended 
responses so that students had to 


construct their responses according to the 


questions. Constructed response 
assessment can be utilized to reveal 
students’ reasoning and 
thinking skills (Ku, 2009; Widiyawati, 
Nurwahidah & Sari, 2019). Students as a 


test taker perform HOTS better in 


analytical 


constructed response than multiple- 
choice due to the less of guessing factor 
(Sangwin & Jones, 2017; Scully, 2017). 
The assessment's main objective 
was to judge the skill-based learning 
outcome of students as well as enhance 
the 


quality of teaching-learning. 


Assessment is an essential process that 
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influences students’ knowledge, skills, 
attitudes, and beliefs more than teaching 
Sultana & Rahman, 2018). Assessment is 
developed following the 21st-century 
biology the 


learning that applies 


scientific approach. This assessment 
aims to prepare students’ thinking power 
in facing the global era. HOTS is a 
thinking whose 


students’ level 


achievements are characterized by 
problem-solving that applies evaluating 
and creative ways of thinking (Anderson 
et al., 2001; Jensen et al., 2014; Widiana 
and Jampel, 2016; Ritter and Mostert, 
2017; Miller, 2018). Students’ HOTS 
performance will guide them to be able to 
connect and describe natural facts, 
concepts as well as manipulate them in 
relevant conditions (Rashika & Salleh, 
2019). 

In 21st-century learning teacher's 
role 


optimization is important in 


providing students 4C skills 
(Communication, Collaboration, Critical 
thinking, and Creative innovation). In 
addition to good process skills by the 
teacher, 21st-century learning can also be 
realized from the student-centered 
learning process. So it is expected that the 
ability to solve problems by utilizing 
critical thinking skills for students can be 
(Tyabaev, Sedelnikova & 
2015; David, 2017; 
Motallebzadeh, Ahmadi and Hosseinnia, 


2018). 


trained 


Voytovich, 
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Science teaching and learning 
develop students’ scientific attitudes and 
also nurtures students’ scientific inquiry 
skills. Students will be able to achieve 
21st-century skills, only if they can foster 
problem-solving with their observation 
and critical thinking skills in science 
classes. Therefore, teachers need to 
create diverse assessment tools that will 
engage students in a HOTS-based 
learning process (Hafiz & Rahman, 
2019). 

The 21st-century biology learning, 
besides being seen from the learning 
process, can also be seen through the 
assessment tool. The HOTS-based 
assessment, in its application, can train 
critical and analytical thinking for 
students. This way of thinking induces 
students to be one step ahead in acquiring 
4C skills 


Therefore, the development of the HOTS 


in 21st-century learning. 
assessment is needed in developing 
critical thinking skills for students (Lile 
and Bran, 2014; Charoencha, Phuseeorn 
and Phengsawat, 2015; Aziz and Yusoff, 
2016; Kinay and Bagceci, 2016). 

The developed assessment 
provides HOTS of revised Bloom’s 
taxonomy in Biology topics. The test 
takers were given 12 items in 3 levels of 
HOTS, namely: analyzing, evaluating, 
and creating. For example, in item 
number 1 in the sub-chapter of Structure 
of DNA and RNA function students had 
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to analyze DNA functions as an 
inheritance. Students must be able to 
explain their arguments on DNA 
functions to determine one’s kinship. 
They had to connect the concept of DNA 
function, the fact of kinship, and connect 
it into a real condition of relatives 
phenotype, as observable characteristic 
(Deznabi et al., 2018; Perego et al., 
2019). Create a connection between 
facts, concepts, or theory to solve the 
problem will improve students’ HOTS. 
The HOTS-based assessment tool, 
which has now been integrated into the 
National Examination Assessment, has 
not yet been made a part of the practices 
for training junior high school and 
elementary school students. In reality, the 
HOTS-based assessment still indicates 
low results, which implies that junior 
high school students’ analytical thinking 
level is still low. This is because junior 
high school students have not been 
intensively accustomed to working on 
assessments that require such critical and 
analytical thinking. In the HOTS-based 
have been 


trials that 


the 


assessment 


developed, maximum results 
obtained for junior high school students 
utilize their thinking critical abilities 
(Giindiiz et al., 2016; Santos, 2017; van 
der Veen and van Oers, 2017). 

The HOTS-based assessment can 
be designed in the different subjects, 


especially in biology subjects, that use a 
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scientific approach in learning. The 
HOTS-based assessment can also be 
applied to all levels of school. The 
secondary school level is ideal for 
applying HOTS-based assessment tools 
and requires more intense than the 
elementary school level. Particularly for 
junior high school students, it is useful to 
develop analytical thinking ability that 
could be improved as they go through 
higher education (Vijayaratnam, 2012; 
Camacho and Legare, 2015; Koh et al., 
2015; Sahronih, Purwanto and Sumantri, 
2019). 

The use of learning devices to 
support HOTS-based learning must also 
be developed in elementary school to 
support students in the future. The 
learning that take place should not only 
work on assessment but must also be 
complemented with appropriate learning 
media. Learning media have an important 
role in delivering important material, 
including, in this case, HOTS-based 
material. Teachers should be able to take 
advantage of this developed assessment 
by also applying web-based learning 
media. There are pieces of evidence that 
web-based learning media are very 
helpful in learning (Nugraini ef al., 2013; 
Baris, 2015; Fatih, 2016; Alomyan, 
2017; Jiang et al., 2017; Alsadoon, 2018) 
CONCLUSION 

Science learning in the 21st 
century should develop the ability of 
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students to solve problems through 
HOTS. This task demands for the 
development of an innovative assessment 
to gauge the acquisition of these skills. 
Thus, this study aimed to design a HOTS- 
based assessment tool on the topic on 
genetics for junior high school students. 
This paper found out that the HOTS- 
based assessment tool has high content 
validity, a good reliability index, and 
acceptable construct validity. Thus, it 
offers evidence that the HOTS-based 
assessment tool is a suitable test for use 
in teaching and learning. 
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